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The document describes the process and presents the 
results of a field test of the Management Information System for 
Occupational Education (BISOE) Census Data System (CDS) Fall Reports, 
The data system was designed to collect and store basic census data 
(mandated State and Federal) for all occupational programs in 
Massachusetts and to meet all of the current data reguirements of the 
Division of Occupational Education, including the Annual Federal 
report. CDS structure related programs, enrollments, and costs (input 
information) to job-entry skills (terminal objectives, or TERMOBS) 
acquired by program completors in 20 program areas (output 
information) • The overall goal of the field test was to measure the 
validity and workability of the CDS in Massachusetts school systems, 
specifically, to test/validate the TERMOBS, the data collection 
process, and the value of the CDS to local educators. Six school 
systems were principally involved in the field test. Although cost 
data was not collected in this field test, the process of collecting 
program, enrollment, and job-entry skill information in a prescribed 
format was fully validated^ The immediate short-term management 
benefits offered by the system are outlined. The tables and addenda 
include all data collected in the test implementation. (A J) 
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• PREFACE 

Thi« document describes the results of the field test 
of the MISOE Census Data System Fall Reports. The test demon- 
strated the immediate usefulness of the Fall Reports to the 
participating schools and the supporting data are included, A 
video-taped documentary of this field test is available and is 
tj^ferenced in Addendum IV. 

As a matter of interest, the documentation pertaining 
to an evaluation of the initial Census Data System Fall Package 
by the participating schools and by staff members of the 
Massachusetts Department of Education is included kn Addendum I. 
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INTRODUCTION 

The MISOE census Data System (CDS) ^ collects and stores 
basic census data (mandated State and Federal) for all occupa- 
tional programs in Massachusetts. It was designed to meet all 
of the current data requirements of the Division of Occupational 
Education, including the Annual Federal Report. CDS structure 
. relates programs, enrtollments, and costs, (input information), ^ 
to job-entry skills (TERMOBs) acquired by program completors 
(output informatibn) . By combining mandated data with management 
data, CDS can reflect the diversity of practice in Occupational 
Education in Massachmsetts. The current system only yields 
j enrollment count by LEA, (not by school), and cannot determine 
the occupations for which students are studying by grade, since it 
aggregates studentilTer^olled in a range of grades, thereby 
preventing determination of effects of program length on program 
I cost and educational outcomes. In contrast, the Census Data 

System's flexibility provides full program specification by grade, 
enabling local schools to account for an ever-widening variety 
of occupational program alternatives. Delineation by student 
group permits accurate reporting of clustered programs— multiple 
' groups of students simultaneously pursuing different skill con- 

figurations within the same program. In addition, CDS enumerates 
the job-entry skills (TERMOBs) program completors are expected 
to acquire, and provides determination of program effectiveness 
j by achievement level index, (using TERMOBs) as criteria- 

referenced tests). 



ERIC 



6 

1 



Although the cost data portion (End-of-Year Report) of 
CDS is still under development, the process of collecting program, 

enrollment, and job-entry skill information (the Fall Report) in 

f *' 
a prescribed format was fully validated in the CDS Fall Report 

Field Test. I 

I 

The Census Data System's foimat was designed to fit into 

: / 

the single department-wide reportiiig system now being developed 
by the Department of Education. / 

The increased quantity and quality of information avail- 
able from the CDS offers immediate benefits to managers of 
occupational education at both the state and local level. The 
totally flexible structure of the Census Data System permits it 
to accurately reflect prac|tice, and thereby acknowledge and 
foster innovation, improy((>tnent , and progress through better 
management of occupatioriftl education. 

This report describes the field test process and its 
results, and breifly outlines the immedijite short-term manage- 
ment benefits offered by the system. The tables and addenda 
include all data collected in tfiis test implementation, including 
a memorandum detailing a preceding initial evaluation of CDS 
by school and Department of Education personnel. 



GOALS AND OBJECTIVES 
This report deals with the MISOE Census Data System (CDS) 
Fall Report field test which was conducted in May and June of 
1974. The overall goal of the field test was to measure the „ 
validity and workability of the Census Data System (CDS) in 
Massachuse.tts School Systems. Specifically, the objective was 
to test/validate the following: 

1) Terminal Performance Objectives (TERMOBs) for 19 
occupational program areas. 

2) Procedures, forms, and the mechanics of the data 
collection process. 

3) Overall value and feasibility of the Census Data 
System (CDS) to the local educational agency (LEA), 
including teachers, department heads, and 
administrators , 



8 

3 



PROCESS 

The School systems 



Six school systems were principally involved in the CDS 
field test: 

♦ - ^ • 

1. Shawsheen Valley Regional 

2. Nashoba Valley Regional 

3. Northeast Metropolitan Regional 

4. Brookline 

5. Newton 

6. Quincy 

In addition, the following school systems were represented 
by one or two program areas: 

1. South jkiddlesex Regional 

2. Belmont 

3. Medfoi^d Vocational Technical 

4. Stonehiam 

5. Greater Lawrence Regional 

In order to obtain a more realistic appraisal of the work- 
ability of the system, three of the six principal schools 
chosen had been MISOE laboratory schools previously, while 
"the remaining three schools had had no prior experience with 
Project MISOE. 

MISOE laboratory school systems: 

- Newton 

- Northeast Metropolitan Regional 

- Quincy Vocational Technical 

'No prior experience with MISOE: 

- Brookline 

- Nashoba Valley Regional 

- Shawsheen Valley Regional 

It should be noted that during the field test and the entire 
data collection process, there was no discernible difference 
between these two groups of schools in terms of output, 
understanding, or reaction to the system. 



Contact With Schools 

Contact with the schools was minimal in order to best 
simulate state-wide ilnplementation on a smaller scale. 
Contact was therefor divided into three major categories at 
each school: 

1) Introductory Presentation - This presentati n 
included a brief background explanation of Project 
MISOE, the CDS system and its potential a|>plication 
and use*bY the LeK, aftd a review of Terminal 
Performance Objectives (TERMOBs) . 

2) Workshop - This contact was directed to participating 
teachers or department heads and involved completion 
of enrollment forms, the validating of instructional 
and TERMOB division and unit outlines, and the^review 
of TERMOBs (by program) with individual assistance 
from the MISOE staf-P. 

a) Post workshop follow-up - Brief trouble shooting 
sessions were conducted with each teacher or 
department head to rectify any individual 
problem areas. 
3) Data Collection Conference - This was an informal 
meeting of teachets and department heads with 
curriculum codfdiiiators , administrators, and super- 
intendents after completion of systems implementation, 
A candid appraisal by all concerned was solicited 
with respect to the overall value of CDS, TERMOB 



coverage, the mechanics of the system, etc. The 
Data collection Conference was video-taped in all 
six sch©o-ls. 
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RESULTS 

A major aspect of the MISOE Census Data System Is its 
structute/ whereby input information in terms of programs, 
enrollment, and costs can be directly related to output infor- 
mation in terms of job-entry skills that program completers are 
expected to perform. Although cost data was not Collected in 
this field test, the mechanics of collecting program, enrollment, 
and job-entry skill information in a prescribed format was 
validated and is discussed below: - 

A. Programs 

The CDS system's means of program identification is 
the United States Office of Education (USOE) Classifi- 
cation of Occupational Instructional Programs by 
USOE code numbers. USOE codes provide the detailed 
specification capability necessary for describing 
occupational programs in Massachusetts. Field test 
results showed 100 percent feasibility in both 
program identification and student group delineation 
(within a program) using USOE codes. (See Table I) 

B. Enrollments 

Delineation by student group (the highest order 
grouping of students receiving identical instruction) 
provides new information on program organization and 
c urriculum divisions within a program. The mechanics 
of obtaining enrollment figures (forms, procedures) 
' was found to be 100 percent applicable in all programs 



In Business Education programs as buffered in regular 
high schools, forms have been developed to account 
for program variability and mobility within a given 
program. 

1) Table I shows the connection that the Census 

Data System makes between programs, enrollments 
(input) ^ and job-entry skills (output). Many 
programs can be described by one student group 
(all students learning the same type and number f 
of skills). However, in some programs, more 
than one student group is needed to describe 
the total program (e.g. Machine Shop Table 1-16). 
In such cases each student group is listed* 
Another example of student group delineation is 
in the stenographic secretarial program (Table 
1-7) whete one special needs student learning 
fewer skills comprises an additional student 
group.' (It is noted that the "Total TERMOBs" 
indicated under each caption in Table I reflects 
the number of objectives which constituted the 
original TERMOB file for the given program. 
TERMOBs 

There was an overwhelmingly favorable reaction by 

teachers, department heads, and administrators alike 

to the concept of Terminal Performance Objectives 

(TERMOBs) expressed as job-entry or marketable skills. 

* Table II is included to facilitate making comparisons 
among all schools in terms of TERMOBs offered by 
program. 



Teachers were especially impressed with the TERMOB's 
ability tp accurately describe the outcomes of their 
programs. 

1) Table III shows the average number of TERMOBs 
reviewed, rated and validated by each school. 
' Since each TERMOB was individually rated on 
program relevance (curriculum validity) , sub- 
■ skill relevance, and clarity, an Overall Value 
Indicator (OVI) was developed encompassing the 
^ above' three ratings , ~OVrs~are^isted by-program 

on a 5 point scale in Table III . The Overall 
Value indicator for all programs was 4.47/5.0 
or 89 percent, program relevance (curricula 
validity) was 4.33/5.0 or 86 percent. 

In general, the Terminal Performance Objectives 
for the 19 programs were found to be highly 
accurate descriptors of the kinds of job-entry 
skills acquired by completers of vocational 
programs in Massachusetts, as shown by the above 
figures and Table III . 
2) TERMOB coverage of programs varied by program 
from a low of 46.6 percent to a high of 100 
percent. The average coverage for all programs 
was 79.18 percent. In three programs, several 
new TERMOB divisions and units and extensive 
additions were made while there was general 



consolidation and additions made where 
necessary in all but tvro programs. Table IV 
shows the percent of TERMOB coverage by program 
(as of the data collection date of June 30) ^ 
the number of TERMOBs by program at that time^ 
the number of TERMOBs added by program^ and 
the new percentages of TERMOB coverage by program. 
Addendum III contains descriptive information 
to support Table IV, ^ 
There was a strong connection between TERMOB 
programs and instructional programs at all 
schools. However r not air TERMOBs were repre- 
sented in the instructional program at a given 
school. One of the forms contained in each 
TERMOB reporting booklet requested teachers or 
department heads to list all TERMOBs covered in 
their instructional program by student group. 
Addendum II, TERMOB Frequency by Program, shows 
the frequency with which each TERMOB appears in 
a given instructional program. Since only three 
schools were represented in each program, TERMOB 
frequency data from the CDS field test is of 
limited value. Variations in ratings of 
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conditions , performances , and extentSr cannot be 
made until the system is compi^er-pperable. 
Howeven, by crossing. TERMO^Yr^qu^hcy data on 
a state-vfide basis, each */RMOB/in a given 
program can be rankrpfdered,* (with component 
rating of conditions, ..pe'rformances , and extents), 
according to its ireQuenct of use both regionally 
and across the state. Yearly updating of this 
information will show changing patterns of 
instruction i^ithin a program. The potential 
advantages to" the LEA, in, terms of curriculum 
development Or revision, are considerable* 
Overall Value of Census Data System to the 
Local Educational Agency 

In addition to video-taped data collection 
conferences r (which included superintendents r 
coordinators, department heads, and teachers) 
each participating teacher or department head 
and each superintendent/director returned a 
questionnaire dealing with their opinions and 
/reactions to the system and its potential 
application in their school. The following 
summarized the information reported in the 
questionnaire. 
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. a) Value to Teadher 

In addition to rating each TERMOB on 
curriculum validity and ease of under- 
standing (see Table III - Overall Value 
Indicators) f teachers and department 
heads were asked to rate the TERMOBs 
collectively for their program on the 
following questions based on fij 5 point 
scale (5 - 100 percent) . 

1, The TERMOBs are up-to-date 
2^ The TERMOBs are comprehensive 
statements, of job-entry skills , 

3. The TERMOBs would be helpful in 
developing a teaching strategy 

4. The TERMOBs would be helpful in 
developing a curriculum 

5. The TERMOBs provide a logical means 
of enumerating to an employer the 
number and extent of skills acquired 
by individual program completers. 

Table V summarizes the teacher/department head 

response to the above questions by program. It^ 

may be condludeS from this data that teachers 

and department heads favorably accept the 

concept of TERMOBs and indicate that they are 

of much value and offer many features which 

would be of benefit to them in the management 

of their programs. 

b) Value to Administration 

The Superintendents/Directors and 

Occupational Coordinators were asked to 

1 / 
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respond to a series of questions based on 
the potential value of the CDS system as 
a management tool. Table VI is the 
tabulated response to the superintendent/ 
director's questionnaire. In general, 
the superintendents responded similarly 
to the idepartment heads and teachers in 
that they observed many management benefits 
offered by the CDS system. 
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CONCLUSIONS 

The MISOE Census Data System field test was successful 
in terms of its goals. The Terminal Performance Objectives , 
<TERMOBs) for 19 occupaitonal program areas have been revised 
and extended to achieve virtually full coverage in all areas. 
(Revised to describe 20 program areas). 

The mechanics of the data collection process was found to be 
100 percent applicable and the overall value and feasibility 
of the Census Data System to the local educational agency has 
been completely documented. A summary of the CDS Fall Package 
Field Test has been compiled into a 30 minute video-tape 

't 

v. 

presentation for use on a state-wide basis. In addition to 
the long-term benefits of the system in improving the quality 
of Occupational Education, the Census Data System's Fall Report 
offers immediate short-term benefits to managers of Occupational 
Education at both the state and local level, as briefly outlined 
below: 

(1) Results approach to Education 
(Management by Objectives). 

- Performance Objectives to specify desired 
educational outcomes by program 

- Performance Objectives as a basis for deter- 

j' mining program effectiveness (accountability) 

- Performance Objectives as a basis for cost 
justification 

(2) Management Tool for Effective Communication 

- Guidance - Program summaries by job-entry 
skill upon which students can make career 
decisions (school with students) 
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- Program Development - "State of the Art" job- 
entry skills utilized to update or develop 
curriculum and program objectives (school with 
advisory councils and employers) 

- Accurate Reporting - Identification of specialized 
programs by student group; differing number and 
types of job-entry skills acquired by different 
student' groups (i.e., jsipecial needs, disadvantaged 
handicapped) (school with department of education) 

The Censu/ Data System's Fall Package is now ready for 
state-wide implementation. ' 
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TABLE I - 



ENROLLMENT BY PROGRAM BY TERMINAL OBJECTIVES • 
TABLE I- I — DISTRIBUTIVE EDUCATION PROGRAM 



TOT 


1 TPRMnRt;. Ah 




Be 1 mont* 


Brookl Ine 


Stoneham 


USOE Code 


04.0600 
vfi4.0300 


04.0800 
04.0200 


04.99 


04.0800 


Enro II merits 


38 


20 


28 


19 


TERMOBS 


40 


24 


24' 


40 



TABLE 1-^ — PRACTICAL NURSING - Grade 13 
TOTAL TERMOBS i 80 





Greater 
Lawrence 


Ou t ncy 


Northeast 


USOE Code 


07.0302 


07.0302 


07.0302 


Enrol Invents 


44 


33 


28 


• TERMOBS 


85* 


83** . 


80 



5* Additional TERMOBS (beyond-^IO^jJ booklet) Included 
jifif II II II II II " 

TABLE 1-3 — OCCUPATIONAL CHILD CARE 
TOTAL TERMOBS: 31 





Greater 
Lawrence 


Brookl Ine 


Northeast 


USOE Code 


09.0201 
09.0105 


09.0201 


09.0201 


Enrol Iments 


12 


12 


13 


TERMOBS 


31 


31 


31 



TABLE I — ENROLLMENT BY PROGRAM BY TERMINAL OBJECTIVES (Cont'd) 



TABLE 1-4 — BUSINESS CLUSTER: 75 TERMOBS 
ACCOUNTING AND COMPUTING 





Newton 


Brookl Ine 


1 




USOE Code 


14.0101 


14.0100 




Enrol Iments 


22 


20 




TERMOBS 


35 


41 





TABLE 1-5 — BUSINESS CLUSTER: 75 TERMOBS 
BUSINESS DATA PROCESS I NG 





Broo 


<l Ine 


Northeast | 




USOE Code 


14.020201 


14.0200 


14.0201 
14.0202 
14.020201 


14.0204 
14.0203 


Enrol Iments 


9 


14 


16 




TERMOBS 


8 


10 


26 



TABLE 1-6 — BUSINESS CLUSTERr 75 TERMOBS 
GENERAL OFFICE 



4 


Newton 


Brookl Ine 


USOE Code 


14.0300 


14.0699* 


Enrol Iments 


45 


25 


TERMOBS 


42 


39 



^USOE Code for •'Personal Training and Related, other," 
but Interpreted as General Office, clerical training, 

22 

18 '^'^ 



* TABLE I ~ ENROLLMENT BY PROGRAM BY TERMINAL OBJECTIVES (Cont'd) 

TABLE 1-7 — BUSINESS CLUSTER: 75 TERMOBS 
STENOGRAPHIC. SECRETARIAL & RELATED 





Newton 


Brook 1 In€ 


Shawsheen 


USOE Code 


14.0702 


14.0799 


T4.070Q 
14.0702 
14.0799 


14.0901* 


Enrol Iments 


19 


II 


16 


1 


TERMOBS 


40 


23 


46 


41 



^Special Education Student Group 

TABLE 1-8 — AUTOMOTTVE BODY 

TOTAL TERMOBS: 59 





putney^ ^ 


Nashoba~ 


Shawsheen 


USOE* Code 


17.0301 


17.0301 


17.0301 


Enrol Iments 


7 


13 


12 


TERMOBS 


54 


48 


46 



TABLE 1-9 ~ AUTOMOTIVE MECHANICS 
TOTAL TERMOBS: 56 





Qu 1 ncy 


Nashoba 


Shawsheen 


ySjOE Code 


17.0302 
17.0399 


17.0302 


*7.0302 
17.0303 


Enro 1 1 ments 


12 


13 


18 


TERMOBS 


56 


56 


56 



23 



TABLE I — ENROLLMENT BY PROGRAM BY TERMINAL OBJECTIVES (Cont'd) 

TABLE l-IO — DRAFTING 
TOTAL TERMOBS: 45 





Northeast 


Brook 1 ine 


Quincy 


USOE Code 


17.1300 

* 


17.1300 


17.1300 


Enrol Iments 


14 


- 18 


12 


TERMOBS 


42 


33 


43 



TABkE t-ll — WOODWORKING \ 
TOTAL TERMOBS: 58 





Qu 1 ncy 


• Shawsheen 


Nashoba** 


USOE Code 


17.1001 


17.3601 
17.10 • 
17,1001 




Enrol Iments 


12 


9 




TERMOBS 


58* 


46 





*Based on TERMOB review only. Table I 

(program coverage) Incomplete. 
**PartIcfpation of Woodworking teacher, (Walter 
Toney), withdrawn. 

TABLE 1-12 — ELECTRICAL 



TOTAL TERMOBS: 53 





Shawsheen 


Nashoba 


Qu i ncy 


USOE Code 


17.1400 


17.1002 


17.1401 


Enrol Iments 


10 


14 


42 


TERMOBS 


36 


43 


"24 



20 24 



TABLE I — ENROLLMENT BY PROGRAM BY TERMINAL OBJECTIVES (Cont'd) 

TABLE 1-13 — ELECTRONICS 
TOTAL TERMOBS: 55 





OUINCY 


1 SHAWSHEEN* 


NASHOBA 


USOE Code 


17.1502 


17.1501 


17.1502 


17.1503 


17.1500 


Enrol Imen+s 


14 


2 


14 


2 


7 


TERMOBS 


44 1 


1 46 


46 


48 


32 



* 3 s+udent groups, learning different numbers and types 
of job-entry skills (TERMOBS) 

TABLE 1-14 — PLUMBING AND PIPEFITTING 
TOTAl, TERMOBS! 58 





OUINCY 


NASHOBA 


NORTHEAST 


USOE Code 


- 17. 1007 


17.1007 


17.1007 


Enrol Iments ' 


29 


10 


22 


TERMOBS 


56 


58 


55 



TABLE 1-15 — GRAPHIC ARTS 
TOTAL TERMOBS: 38 





NORTHEAST 


BROOKLJNE 1 


1 QUINCY 


JSOe Code 


I7.I90D 


17.1901 
17.1902 

J7»L9a3— 
17.1904 


17.1901 
17.1902 
17.1903 _ 
17.1904 


17.1501 ' 
17.1902 , 
17.1903 
17.1905 
17.1906 


Enrol Iments 


17 


1 1 


6 


10 


TERMOBS 


31 


20 


10 


21 



25 

21 



TABLE I — ENROLLMENT BY PROGRAM BY TERMINAL OBJECTIVES (Cont'd) 

TABLE 1-16 — MACHINE SHOP 
TOTAL TERMOBS: 57 





NASHOBA 


' QUINCY* 


SHAWSHEEN 


USOE Code 


17.2302 


17.2302 


17.2302 


17.2302 


^ Enrol Iments 


12 


2 


' 0 


24 


TERMOBS 


56 


36 


49 


57 



* No 12+h grade program comple+ors In 1973-74. 

TABLE 1-17 METALWORKING* , 
TOTAL TERMOBS: 37 





SHAWSH 


EEN** 


OUINCY 


NASHOBA. 


gSOE Code 


17.2304 


17.2305 


17.2305 


17.2300 


Enrol Iments 


, 16 


16 


18 


3 


TERMOBS 


26 


12 


30 


32 



* comprising both metal fabrication and welding 
** dlfferentatlon of me+al fabrlcatlon/weldlng by student 
group # ' 

TABLE 1-18 — COSMETOLOGY 
TOTAL TERMOBS; 45 





NORTHEAST 


KEEFE 


MEDFORD 


ySOE Code 


^ 17.2602 


17.2699 


17.2602 


Enrol Iments 


14 


13 


15 


TERMOBS 


30 


45 


45 



26 

22 



TABLE I — 



ENROLMENT BY PROGRAM BY TERMINAL -OBJECT IVES (Cont'd) 
\ TABLE 1-19 — QUANTITY FOODS 
TOTAL TERMOBS: '69 





OiJINCY 


SHAWSHEEN 


NORTh 


lEAST 


USOE'Code 


17.2902 
17.2903 
17.2999 


17.2902 
17.2903 
17.2901 


17.2901 


17.2902 
- — -(— 


17.2901 


Enrol t merits— 


— IXX— 


14 


? 


7 


7 


TERMOBS 


' 68 


61 


6 


49 


* 



* not aval I able 



27 

23 



TABLE II: AVERAGE NUMBER TERMOBS OFFERED PER PROGRAM 



BY SCHOOL SYSTEM 











S C 


H. 0 0 L 


S Y S 


T EM 


S 












■ i 
i 1 


PROGRAM 


SHAWSHEEN 


Ul 

z 
o 


NASHOBA 


NEWTON 


NORTHEAST 


QUINCY 


GTR. LAWRENCE 


Ul 

CD 


STONEHAM 


medford 


SOUTH MIDDLESEX 






DISTRIBUTIVE 




35 












40 


40 










PRACTICAL 
NURS 1 NG 




• 






47* ■ 


83 


85 














OCCUPATIONAL 
CHILD CARE 




.31 






31 




31 














.ACCOUNTING 




41 




35 




















DATA 

1 PROCESS 1 NG 




12 






26 


















GENERAL 
OFFICE 




39 




42 




















STENO., H 

[SECRETARIAL 


47 


23 




40 




















IaUTO BODY 


46 




48 






54 
















1 ' \ 
1 

IAUTO 

1 MECHANICS 


56 




56 






56 














i 


[drafting 
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42 


43 





















* Incomplete review 
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TABLE III: TERMQBS REVIEWED, RATED AND VALIDATED 
^ * BY SCHOOL SYSTEM 

OVI = Overall Value Indfcator 



SCHOOL SYSTEM S 



PROGRAM 



DISTRIBUTIVE 
TERMOBS: 40 



LU 



in 



in 



1 



to 



35 



CD 



CO 



40 



z: 
o 



Q 

tr 
o 

Q 
LU 

2: 



in 
o 

Q 

s: 

X 
ZD 

o 
cn 



40 



PRACTICAL 
NURSING 
TERMOBS: 80 



77 



80* 



OCCUPATIONAL 
CHtLD CARE 



31 



ACCOUNTING 
TERMOBS: 75 
OVI = 5.67 
bAYA PRXESS. 
TERMOBS: 75 
OVI = 4.24 



40 




25 



GEN'L OFFICE 
TERMOBS: 75 
OVI =4.78 



65 



STENO., SECY 
TERMOBS: 75 
= 4.65 



47 



73 



AUTO BODY 
TERMOBS: 59 
OVI - 4.66 



46 



) 



49 



55 



AUTO MECH. 
TERMOBS: 56 
= 4.70 



56 



56 



56 



DRAFTING 
TERMOBS: 45 
OVI * 4.61 



42 



42 



42 



* Incomplete review 
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TABLE III (CONT); TERMOBS REVIEWED, RATED AND VALIDATED 

BY SCHOOL SYSTEM 



OVr = Overall Value Indicator 




TABLE IV: ESTIMATED TERMOB COVERAGE 
OF INSTRUCTIONAL PROGRAMS 

1. .Overall TERMOB coverage for all 19 programs: ..79.18% . 

2. Overall curriculum validity (program relevance):* 9i;4% 



3. TERMOB coverage by program. 

ESTIMA'tED 


ORIGINAL 
NO. OF 

TP.WMnTiS ADDITIONS 


CURRENT 
COVERAGE J^|% 


( 1) DISTRIBUTIVE 


80.0 


46 


(10) 


95 


( 2) PRACTICAL NURSING 


85.0 


80 


(12) J 


90 


( 3) OCC. CHILD CARE 


93.3 * 


31 


( 8) 


95 


( 4) ACCOUNTING 


. 90.0 


47* 


( 3) . 


90 


( 5) DATA PROCESSING 


50.0 


48 


(22) ' 


90 


( ey iSENERAL OFFICE 


95.0 


41 




95 , 


(7) STENO., SECRETARIAL 


90.0 


46 


( 5) 


95 








(8) AUTOMOTIVE BODY 


85.0 


59 




90 


( 9) AUTOMOTIVE MECHANICS 


86.0 


56 


( 7) 


90 


(10) DRAFTING 


75.0 


45 


( 7) 


80 


(11) WOODWORKING 


90.0 


58 




90 


(12) ELECTRICAL 


,83.3 


53 


(10) 


90 


(13) ELECTRONICS 


73.3 


55 


(25) 


90 


(14) PLUMBING 


60.0 


SB 


(42) 


95 


(15) GRAPHIC ARTS 


46.6 


38 


(24) 


90 


(16) MACHINE SHOP 


78,3 


60 

•* 


(12) 


85 


(17) METALWORKING - 


66.6 


37 


(11) 


80 


(18) COSMETOLOGY 


96.6 


45 




95 


(19) QUANTITY FOODS 


80.0 


69 


(15) 


90 
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* 4 program areas considered as the Business Cluster consisting 
of 75 different objectives (See Table I) 
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TABLE V: DEPARTMENT HEAD EVALUTAION SUMMARY ^ 



T*PPMOR<5 ARP** 

♦ 

* 

-PROGRAM 


1 

UP-TO- 
DATE . 


2 

COMPREHENSIVE 
J OB- ENTRY 
SKI LLS 


Helpful in 
planning 
teaching 

. strategy 


4 

HELPFUL IN 

PLANNING , ' 
CURRICULUM' 


5_ 

MEANS OF 
SKILL 
ENUMERATION 


K DISTRIBUTIVE. 


4.6 


4.6 


5.0 


5.0 


5.0 


2. PRACTICAL NURSING 


4.3 


4.3 


. 4.3 


4.4 


4.3 


3. OCC. CHILD CARE 


476 — 


476 — 


5.0 


- -5.0 


5.0 


4/ ACCOUNTING 


4.0 


'4.0 


4.0 


4.0 


5.0 


5. DATA PRXESSING 


3.5 


4.0 


5.0 


5.0 


5.0 


6. GENERAL OFFICE 


5.0 


4.0 


4.0 ■ 


5.0 


5*.0 


7. STENO.. SECY * 


5.0 


5.0 


4.3 


4.0 


5.0 


8. AUTOMOTIVE BODY 


5.0 


5.0 


5.0 


5.0 


5.0 


9. AUTOMOTIVE MECH. 


4.6 


4.6 


5.0 


5.0 


5.0 


10. DRAFTING* 


3.0 


5.0 


5.0 


5.0 


5.0 


II. WOODWORKING** 


4.0 


4.0 


4.0 


' 4.0 


4.0 


12. ELECTRICAL " 


4.3 


4.6' 


4.6 


4.3 


4.3 


13. ELECTRONICS 


4.3 


4.3 


4.3 


4.6 * 


4.6 


14. PLUMBING 


4.0 


4.3 


4.6 


5.0 


4.3 


15. GRAPHIC ARTS 


3.6 


4.6 


4.6 


^ • -J 


A A 


16. MACHINE SHOP 


3.6 


4.3 


4.0 


3.6 , i 


4.6 


17. METALWORKING 


5.0 


4.7 


4.5 


4.7 


5.0 


18. COSMETOLOGY 


5.0. 


5.0 


4.6 


^4.3 I 
• — t- 


4.6 


19. QUANTITY FOODS*** 


5.0 


4.0 


5.0 


4.0 


4.0 



* Brookllne, Northeast not returned 
** Qulncy, Nashoba not returned 
*** Northeast not returned 
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Table VI: Superintendent Eval uatton Summary 



your school system for all of your programs as an on-going process, 

(I) Do your teachers feel that they would be useful to them as a 
means of communicating with 

( Please register a rating f nom .1 to 5 where I Is the lowest rating ) 



Superintendent's 
Rating 

a, , students-parents 3. 8 

b. superiors (department head, superintendents) 4*0 
c* advisory^ councils ' 3.8 
d. employers " - 4.4 

(2) Do your teachers feel they would be useful to them a^ guidelines 
for curriculum development purposes? 4.6 

(3) In your judgement, would your teachers use them? 

Yes IOO!t No 

If no, please explain briefly 



(4) Do you feel that the TERMOBS would be useful to you a$ a means of 
communicating with 



a. students-parents ^ 4.2 

b. teachers 4.2 

c. advisory councl Is 4,2 

d. employers 4.6 

e. Department of Education 4.2 



(5) Do you feel that the TERMOBS would be useful as a management tool? 

Yes 100^ No _ 

If no, please explain briefly 
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(6) Would you use TERMOBS? 
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Yes 1 001 No 



ADDENDUM 1 



INITIAL CENSUS DATA SYSTEM FALL PACKAGE EVALUATION 
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DIVISION or OCCUPATIONAL 
CDUCATION 



1017 Jliain <Si 

01S90 
617^729-9260 



MANAGCMKNT Ik INrORMATION 

January 30, 1974 •y«tkh 



Tot Dr/ Gregory Anrlg " 

Ctommlssioner of Education ^ 

From: 6r. Charles H. Buzzell, Associate Commt ssloner 

Division of Occupational Education 

Subject: Project MISOE - Census Data System 

The first purpose of this memorandum Is to describe my Impress ton 
of an evaluat!ofr5r"a part of the Census Data System (CDS) developed Dy 
MISOE. This evaluation was conducted by several local school systems (see 
•Appendix A). The second purpose Is to sgeclfv recommendations for an Im- 
plementation schedule of that part of the CDS that' has been evaluated and 
for final development of COS. This memorandum is divided tnto three parts: 

Part I - A review of the Census Data System as developed by MISOE 
for the Division of OcdupatlonaT Education (DGE) and Its fit Into 
the Census Data System of the entire Department of Education; 

Part II %^ description of the evaluation' process of the ''exposed" 
part of Coh and my impression of that evaluation. Appendix B stipu- . 
lates specific responses by the local schools and a frequency count 
of agreement or disagreement to each positive or negative criticism; 



Part III - A recortfnendatlon for Implementation and continued develop- 
meat of "the CDS for the Division of Occupational Education, in 
coordination wi.th the total Department. 



PART 



^ A Review of the Census Data System 

"D ■ 

of the Division of Occupational Education . 

The data gathering part of the census data system of the Division of 
Occupational Education has been divided Into two separate sections: The 
Fa 1 1 Report and the End-of-Year Report . The Fal I Report includes the follow- 
TncTtypirof I nformaTTonT" occupational education enrol Iments by grade, 
occupations (USOE Codes), student type, school and geographic setting, and 
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Terminal Performance Objectives (TERMOBS). 'The current system only yields 
^rvr^rrn«nt-comts -by^f^-fno1-schooB-tjnd-4^-^t-rHiety H^^iannot - 



enrol iiiwni i-uuiiia uj.<» • . , j 

reflect the occupations for which students are studying by grade, nor c< 
the current system accommodate any curricula flexibility beyond lump numbers 
of students enrolled in a range of grades learning skills for one occupation. 
Current enrol I ment information does not accurately reflect practice, is 
rlgidifying of practice, and frequently is misleading, because of its 
structure. 

The MISOE-CDS enrol i ment* system permits local schools to account 
for a wide variety of occupational program alternatives, ranging from short 
courses designed to prepare students with a limited range of skills, to com- 
plex, cluster programs, with multiple groups of students simultaneously 
pursuing different occupational skill configurations within the same prograrj. 
Wenrotttfient-des-crrp-H-on-of MI SOC has bee n p ai-ns4^-^ft giy devo l,op&d^-KO-- 
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vide an accurate description of practice in a manner that in no way facili- 
tates curricula. rigor rrtortis. 

In summary, the enrol iment section of the CDS Fail Repoi-^^P^vMes a 
descripti-on of the occupations and skills within occupations (TERMOBS) which 
students are learning in a way that can be responsive to a wide range of^ 
management concerns at state and local levels, ranging from manpower poUcy 
concerns to issues of appropriate educational Influences for human grdiwth. 

It Is important to understand that MISOE-CDS has been structured so ; 
that It can aggregate and disaggregate enrollment (and all other data by a 
wide variety of program, geographic, school, grade and student type dimen- 
sions Iiisj^rvM^. This planned .provision gives MISOE-CDS its power In , , 
supporting a range of information needs by management. ' ^ 

The Fall Report also includes other Information, flexibly structured_ 
as is enrol iment data: (1) Utilization and capacity of school ^pace by OE 
program, by school, by time of day and year; (2) a general description of 
staff characteri stics ; (3) a description of the varying length of OE £ro- 
: -. I /^gnS" by lchooi , and (4) the distribution of faculty teaching time over OE 
\ programs. . 

\ It Is useful to understand that the Fail Report is structured to connect 

wlt^ the End-of-Year Report, yielding expenditure by OE program (within 
school ) information. 

The End-of-Year Report (not evaluated by the cooperating schools) Is, 
in f a"a^ TThTee'llSge'suppTement to the existing End-of-Year Financial 
Report of the Department of Education, its implementation requires a coordi- 
nated coding and logistic d0ve iopment. between DOE and the Department., which 
will result in one, integrated census data information system for the entire 
Department. Such a system will provide DOE with the special I zed management 
I ittt<irmatiaLj-t requires in a way that is maximally coordinated with the 

CensusDatTsystem of the Departnent. A diagrammatic conception of the re- 
lationship between Department and DOE Census Data Systems Is as follows: 
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Department of Education 
' Census Information 



Note 



DOE 



Census Information System 



,lFa 1 1 fteport 

— En^^^0^4^T ^ont by Q E-p- rogram and 



groups within programs, 

2. Enrol Tment by TERMOB config- 
urations within OE programs. 

3. Uti I izat ion and, capacity by 
OE program. 

4. Staff characteristics. 

5. Length of OE programs. 
End-of-Year Report 

I. Expenditure by OE program. 



(1) DOE Census Data System/(expendi tures and enrol I merit data), is 
reconcilable to the Department-wide system at the LEA level and 
above. , 

(2) The DOE Census Data System Is designed to be ' "t^f^?!!^!'/"^'^ 
that managenfent can instantly retrieve from self-Initiated 
inquiries, numerical summaries, cross-tabs, or even) mathe- 
matically manipulated results of analysis for all data within 
the system. 



PART 



A Descrl ptlon of the Evaluation Process of the Fa \ I Report 

Of MISOE-CDS b^ Participating Schools 

. The five participating schools based their evaluation upon the experl 
ence of actually filling out all of the forms ^in the FaM Re£ort . All 

■/ ' . 3S ■ 
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schools (but one, due to a snow storm) attended a workshop conducted by the 
MISOE staff, designed to help them with the reporting task and understand 
the management consequences of the Information provided by the Fall Report. 
The MISOE staff also provided assistance to each school In the field during, 
the TFTaT experience. In each of the partlcfpatlng schools,, a minimum of ^ 
one department head and one administrator participated. The schools were 
purposefully Selected to represent a'broad range of settings (from tradi- 
tional to Innovative) In which occupational education Is offered. The ex- 
periment was limited to the secondary level. 

The evaluation took place at the Department of Education on January 21, 
-r9-74-at-a-me e ti ng which w a s stru ctur e d such th a t all "evali ia tors" had an 



Opportunity to -respond to both general and specific parts of the Fall 
Package. It should be pointed out that the "evaluators" were aware of the 
connectlbl llty of the MlSOE-CDS Fall and End Year packages, and. In general, 
were responding to the data of the whole -CDS system, and the i;eportIng forms 
of the Fa 1 1 Package. 

Appendix B Itemizes responses on the part of the "evaluators" b-y role 
(administrator or department head), and the following IS my Impression of 
the response of the "evaluation." 

1. The general response to the data yielded by the Fall Report. 
Torms and guidelines was almost overwhelmingly favorable. The 
single excepttonto this Judgement was from one school which fal led 
to attend the previously cited workshop, due to the snow storm. ^ 

2. The "evaluators" pointed to a need to provide we I I thought 
through workshops and assistance to schools In understanding the 
usefulness of the CDS Information to the management function and 
the process of organizing themselves to easily provide the Infor- 
mation required. In sofne Instances, considerable lead time will 
be required to organize a process for schools to provide the in- - 
formation In the format required. (This will be equally true 
with the expenditure supplement of the End Year Report). I am 
sensitive to this problem and attempt tp- deal with It In my recom- 
mendations, (Part III). 

3. It was recommended that the Department commit Itself to the 
Z5dS system over time (administrations). In particular the MlSOE- 
CDS system which meets data requirements without forcing structure 
upon practice. 

4. Office education-, which Is structured In the comprehensive 
Flgh school quite differently than other occupational education 
programs, presents problems not fully solved by the existing MISOE 
Fall Reports, The Office Education "evaluation" found the Information 
useful, but some alternatives are required In the Fall Repot^t to 

facl II tate reporting. This finding is dealt with in my recommen- 
dations of Part III. " 
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5 All participants were extremely positive toward the TERMOBS 
a"nd enrollment breakdowns within programs by TERMOBS, except the 
school that failed to attend the workshop. 

6 Most participants suggested that cost Information could be 
Misunderstood" when arrayed by OE program. If not accompanied by 
benefit -data. In a way that allows meaningful comparisons for 
decision making. 1 do not deal with this objection in my recom- 
mendations, but now stipulate'that: (1) The Sampje Data Systems 
of MISOE (unlnplemented) are designed to treat this concern over 
the long run, whi le the "Interim Impact study" (now belfig^de- 
liberated by the Assessment Group) deals with It In the shor^ haul. 



7. There was a positive response to decentralizing Information of 
the MISOE-CDS type from the central office to the department level, 
except for the school that missed, the workshop. 

PART III 

Recommendations for Implementation and Developmen t of MISOE-CDS 
, for the Division of Occupational Education 

I The Fall R eport be Implemented In alcT^ools on the North Shore 
offering ^up^o'SiTi^ucatlon, except for Off! te Education. Based on our 
previous experience, 'an Improved "workshop" process is evolvngC ready now 
for display), which will be most useful in this task. This '^-^f . 
will be coordinated with DOE's current data collection activities, to avoid 
double reporting. Moving now to this scale of Implementation will provide 
a necessary experience to "shake out" any remaining "bugs", P;-'^ 
wide adoption. It will also provide a broad base for validating "ERMOBS, 
and. finally, should develop a representative group of practitioners at the 
local level who arp able to support through experience the contribution of 
MISOE to structuring and describing occupational education for improved 
DO I Icy making. A "real data" report of this experience should make obv ous 
the necessity of such Information for rational management at the state level 
In meeting Its leadership and compi I ance responstbl I Itles in the field of 
occupational education., 

2. In a way c66rdlnated with our federal reporting data colleqting 
responsibilities, I suggest we allow about one month to make a "^ew 
structured changes In the Fall Report to accommodate the needs of Office 
Education, and collect Fall Report Information in a limited but representa- 
tive number of 'secortdary schools on the North Shore (about 6). All the 
positive advantages of Recommendation #1 VP'V +o Recommendation #2, too. 
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3. Immediately, negoti ations should begin between the Ml SOE staff 
and thos e responsible for the Information system of the Department, so that the 
End-of-Year Reports can be Integrated such that a Department-wide Census Infor- 
mation System can evolve, which will provide DOE with the information It needs 
(previously cited). In a way that Is maximally merged at the Department level. 
Obviously, an Implementation scheduf<> for the entire Department package will 
depend upon development progress. Mthougii It. might be inappropriate for me 
to say this, the I^IISOE staff has solved «'>cM' of the conceptual problems, and 
what essentlaMy remains to: b« done Is the difficult business^f developing 
guidelines and forms for the End-of-Year Package, as wejj.^ determining a way 
to coordinate Fall Reports (the Department's and DOE's). Finally, a plan must 
be evolved for statewide adoption of a single Census Data System, which Is in- 
tegrated on both the reporting and analysis ends. 

I should point out that our plan has been that the MISOE,^evelopment staff 
would conceptualize an "Integratable system" for DOE, and develop and 
field test the guidelines and forms necessary for adoption, as well as the 
adoption pcocess, and then turn this process for management oyer to the 
Division of Occupational Education. It Is our hope that we wl 1 1 be able to 
coordinate the conceptual coordination with the Department of Education. It 
will be the function of the Deparfment to pursue the conceptualized development 
of an Integrated system through the .dl f f I cul t stages of guidelines and forms 
development, as well as adoption. " • 

All of the* above has dealt with only the CDS of MISOE. The Sample Data 
Systems, which allow an estimation of the causation of the occupational educa- 
tion process qn the students and the society It attempts to serve, is a separate 
entity, but one which Is connectlble to the Census Data System within the 
Division" of Occupational Education. . , 
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APPENDIX A 

EVALUATION SCHOOL PARTICIPANTS FOR JANUARY 21, 1974 MEETING 



N EWTON 

Orrl n Brawn , Dl rector, VocationaT Educati on , 
Ernest Repucci , Department Head, Graph rc Arts 
Volln Wells, Department Head, Business 



QUINCY ' < 

Maurice Daly, Assistant Superintendent 

Patrick Grozier, Department Head, Electronics 

Paul Milward, Coordinator, Electrical 

Charles Magnarehl , Department Head, Auto Mechanics 

Patricia Gorman, Research Assistant 

GREATER LAWRENCE 

Roland Cotton> Assistant Superintendent 

Howard Smith, Business Manager 

Ava Pula* Department Head > Practical Nursing 



GREATER FALL RIVER 

John Harrington, Superintendent 

Russe 1 1 Booth, Department Head* Machine Shop 



NORTHEAST METROPOLITAN 

John Connolly, Superintendent 

Henry Corcoran, Department Head, Electrical 
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APPENDIX B 

SPECIFIC RESPONSES TO M1S0E-CDS FALL PACKAGE 
NEGATIVE RESPONSES ADMINISTRATORS 
t. Forms are tfme consuming. 2 

2. Data Is not useful. 

3. Report forms cause same problem for Office 
Education in reporting enrollment as 
existing forms. 

4. Costs of MISOE are prohibitive. I 

5. There is some duplication in the 
nursing programs. I 

6. TERMOBS are too unwieldy, are cut too 
flrta^, and could have been developed 
easier. ' 

7. Forms are difficult to fljl out. 
POSITIVE RESPONSES 

1. MISOE is an e>?cel lent and necessary concept. I 

2. MISOE should be continued, an Investment has 
been made and we need a payoff. I 

3. The data MISOE can provide is crucial 
(accurate In detail). 2 

4. MISOE can package data to meet an Individual 
LEA^s needs. 2 



5. In the future there wl II be a need for more 
fiscal detail, which MISOE can provide. 

6. / Standardized reporting Is coming MISOE 

can help us. 

7. MLSOE does not duplicate present efforts. 
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POSITIVE RESPONSES ADMINISTRATOR? 

8. MISOE will be Invaluable In relation to 

program budgeting* ' 

9. MISOE wl I4s^rve to coordinate and Inform 
many educator! (put them Into the picture). 

This Is not currently done, and will I 
support more rational arid comprehensive 

practice, 

- ' 

lO,. MISOE can check on teacher performance and 
curriculum development 

*, 

IL There Is a definite need to get a handle 
on cost^ and benefits as all school 
systems are on a program budget in some 
sort. MISOE can provide this. I 

12. MISOE is an accurate reporting system and 

provides a standardized reporting format, 1 

13. MISOE eliminates reinventing the wheel 

14 Present programs will not require a lot 
of work to convert to the MISOE format ^ 

15, TERMOBS will be an excellent resource In 

the implementation of Chapter 766 I 

16, TERMOeS will help show relevance to 
students, parents and public, 

17, TERMOBS are great I 3 

18, TERMOBS would be helpful in developing 

new programs. ' " 

1 9 , TERMOBS a re we 1 1 worth the time, ef fort ____ 
and money put into fheir developmefTt . 

20, MISOE Is a hew and better way of 

reporting "^"^ ' 
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OTHER 



T 



ADMINISTRATORS 



L There U a need for workshops for LEAs oh 

how to fill out appropriate forms (staff 

training) and take fuU advantage of 
Information provided I 

2. Information from MISOE could be misread 
as threatening 

0 

3. Caution: Moving from one system of 
reporting to another Cslmple to complex) 
Is difficult. Don't assume the state can 

go to this level. Baker 
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Addendum II - TERMOB FREQUENCY BY PROGRAM 
Addendum M-l - Distributive Education Program (Cont'd) 



TERMOB No. 


Belmont 1 


Brook line 1 


Stoneham 


026 


X 1 


X 


X 


i 027 


X 1 




X 


028 


X 1 


X 


X 


029 


X 1 


X 


X 


1 030 


X 1 


X 


X 


031 


X 




X 


032 


X ; 1 




i^. X 


1 033 


I 

X 




X 


1 034 


X 




X 


1 ' 055 


X 




X 


j 036 


X 


1 . ■ t . ■ . 1 




037 


X 




X 


1 038 


X 




X 




X 


1 


X 


1 040 


X 




X 










































































\ • ■ ■ " • ■ 
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Addendum 1 1 - TERMOB FREQUENCY BY PROGRAM 
Addendum 11-2 - Practical Nursing Program 



1 


TERMOB No. 


Greater Lawrence 1 


Oulncy 1 


Northeast 




001 


X 


1 

X 1 


V 
A 


r 


002 


X 


X j 


X 




* 

003 


X 




\> 
A 


t 1 


004 


X 


X 1 


X 




005 


X 


X 


X 




006 


X 


X 


X 




00^ 


^ 1 

X 


X 


V 
A 


i I 


■ 008 


X 




V 
A 


* 


009 


X 


X 


V 
A 




010 


X . 


X 


X , 




OH 


X 


X 


X 


4 


012 


X 


1 ^ 


X 




013 


X 


X . , . - 


I X 


1 


014 ■ 


X 


X 






015 


X 


X 


V 




016 


X 


X 


1 X 




017 


< 


1 ^ 


1 V 

1 ^ 




1 018 


X 


1 ^ 


1 X 


} ... 


019 


X 


1 ^ 


1 A 




020 


X 


1 ^ 


1 V 




1 no 1 

1 OiC 1 


y 


1 X 


1 ^ 




022 


X 


X 


X 




023 


X 


X 


X 




1 024 


X 


X 


X 


<^ . 


1 025 




1 X 


1 X 
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■ Addendum 1 1 - TERMOB FREQUENCY BY PROGRAM 

^- A- J 

' Addendum H-2 - Practttfel Nursing Program <Co 



- I 



TERMOB No. 


Greater Lawrence 


Qulncy 


Northeast 


026 


X 


v 
A 


V 
A 


027 


X 


X 


V 
A 


028 


X 


V 

A 


V 

A 


029 


X 


V 

A 


V 

A 


030 


X 


X 


V 
A 


031 


X 


X 


X 


032 




X 


V 

A 


033 


— ' ) 

— ^ — /— 


X 


V 
A 


034 


X 


X 




035 


X 


A 


V 
A 


036 


•J X 


X 


V 
A 


037 


X 


X 




038 


X 


X 


Y 
A 


039 


X 


X 


V 
A 


040 


X 


A 


V 


041 


X 


X 


X 


042 


X 


V 
A 


Y 
A 


043 


X 


V 

A 


Y 
A 


044 


X 


X 


Y 

A 


045 


X 


X 


Y 
A 




X 


X 


X 


047 


X 


X 


TERMOB review 
stopped at 047 


048 




X 




^349 


1 

X , ,„ , ] 


X 




050 


X 


X 





47 




Addendum 1 1 - TERMOB FREQUENCY BY PROGRAM 
Addendum 11-2 - Practical Nursing Program (Cont'd) 



TERMOB No. 


Greater Lawrence 


Qu I ncy 


Northeast 


051 


X 


X 




052 


X 


* 

X 




053 
V «/ «x 


x 


X 


* 


054 




X 




055 


X 


X 




056 


X 


. . X 




057 


X * 


\ 






X 


X 




n5Q 


X 


X 






X 


X 




06 f 


X 


X 




062 




X 




063 


X 


X 




064 \ 


X 


X 




065 


X 


X 




066 


X 


X 




067 


X 


X 


--- 


068 


X 


X 




n6Q 


X 


X 




070 


X 


X 




071 


X 


X 




072 


X 


X 




073 


X 


X 




074 


X 


X 




075 


X 


X 





ERIC 
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Addendum \ I - TERMOB FREQUENCY BY PROGRAM 
Addendum 11-2 - Practical Nupslng Prc^am (Con+»d) 



TE^IMOB ^^o. 


Greater Lawrence 


Oulncy 


Northeast 


1 U/D 


Y 

f\ 


X 




1 U// 




X 




1 A*T O 


Y 


X 




1 n*7Q 

1 u/y 


X 


X • ' 




1 * 

f ADA 

1 OoU 




X 


























































> • 




■ + 


^ - 















































































V. 
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Addendum 1 1 - TERMOB FREQUENCY BY PROGRAM 
Addendufn 11-3 - Occupational Child Care Program (Cont'd) 



TERMOB Mo. 


Greater Lawrence 


Brook 1 Ine 


hiortheast 


026 1 


X 1 


A 


X 


1 027 


X 


V 

A 


X 


1 028 


X 


A 


X " . 


029 


X 


Y 
A 


V 

/\ 


030 


X 


V 
A 


V 

A ^ ^ 


031 


X 


A 


X 
































f 


1 w 1 
































1 * - 


L 








1 / 




* 






^ — — 

»n - -■ ■ ■ 


, — — — j 


















































^\ — 




t 
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S = stenographic 
. . 4 Secretarial 

A « Accounting 

& Computing 



Addendum 1 1- TERMOB FREQUENCY BY PROGRAM 
Addendum 11-4-7 - Business Cluster Programs 



erJc 



TERMOB No. 



001 



002 
003 
004 



005 
006 
007 
008 
009 
010 

01 r 

012 
013 
014 
015 
016 
017 
018 

or^ 

020: 
021 
022 
023 
024 
025 



Newton 



0_ 
_0_ 
_0_ 

0 



1. 
S 



Brook 1 Ine 



A_ 
A 



0 = Gerittioi Office 
D = Data Processing 



Shawsheen 



s 



54 



52 



S - stenographic 

& Secretarial 

t 

A =^ Accounting 

& Computing 



Addendum .11 * TERMOB FREQUENCY BY PROGRAM 0 Gen. Off ice 

Addendum 11-4-7 - Business Clusjter-Programis (Cont'd) 

D = Data Process. 



TERMOB No. 


Newton 


' Brook line 


Shawsheen 


026 


O S 


0 A 


c ' 
o 


027 


0 s 


n Q A 
U on 


s 


- 028 


0 s ' 


r\ C A 




029 . 


0 s. 


r\ c A 
0 o n 




030 


0 s 


r\ c A 

0 o n 


w 


^1, 031 


0 s 




Q 


032 


0 s 


0 


c 


033 


0 s 


0 


Q 
\j 


034 


O S 


n ■ ' . 


S 


035 


0' s 


C A 




036 


0 s 


n 


% 

O 


057 


0 s 


A 


c 
o 


038 


0 ^ s 


s 


o 


039 


O S 


b 


c 


040 


0 s 


b 


s 


041 


0 s 


c 
5 


c 


1 042 ' * 


A 


0 A U 


^ c 


1 

•043 


A 


r\ AH 
0 A U , 


) 

— X — ^ — — - — 


044 


A 


0 A 




045 


A 


0 A 


Q 




0 ' A 




s 


■ 047 


0 A 






048 


0 A 






049 


O S A 


0 A ^ 




050 


S * A 


0 A 
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S = ^■''|"^^j;P!f^J,jj,> Addendum II - TERMOB FREQUENCY BY PROGRAM 0 = Gen. Off!ce 

« 

/Vt Accounting Addendum 11-4-7 - Business Cluster Programs (Cont'd) 



i Computing 



D = Data Process. 



ERIC 



TERMOB No. 


Newton 


Brook 1 Ine 


Shawsheen 


051 


A 


0 A 




052 


A 


0 A 




053 


A 


0 A 




054 


A 


0 A 




055 


A 


r\ A 

0 A 




"056 


A 


0 A 


- 




A 


0 A 




■ °" V , 

058 . 


A 


0 A 




059 


A 


0 A 




060 


A 


0 ' A 


* 


061 


A 


0 A 




062 


A 


r\ A 

0 A 




063 


A 


U 




064 


A 


n 
U 


^ 


065 


A 


n 

U . 




066 


A 


U 




067 


A 


U 




068 


A 






069 


A 


U 




070 


A 


n 
U 




U/ 1 


A 


D 




072 


A 


D 






A 


0 




074 


A 






075 


A 
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Addendum H - TERMOB FREQUENCY BY PROGRAM 
Addendum 11-8 - Automotive Body Program 




Addendum 1 1 - TERMOB FREQUENCY BY PROGRAM 
Addendum 1 1 --8 Automotive Body Program (Cont'd) 



♦ 


TERMOB No. 


Qulncy 1 


Nashoba 


Shawsheen ' 






U 4^ u 


— — 1 

X 


X 


X 






n 7 

* 


X 


X 


X 






\^ ^ u 


X I 


X 


X 






V it ^ 


X 


X 


. X , 


s 






X 1 

' \ 


X ' 


X 








X 


•x 


X 






032 


X 1 


X 


X 






033 
\j ^ J 


X 1 


X 


X 






034 


1 

X ' 


X . 


X 


i 




035 


X 


X 


X 






n 3fi / 


X 


X 


X 






0 3 7 y 


• 

X 


X 


X - 






0 3ft 
U -> o 


X 


1 ^ 


X 






0 3Q 


X 










OAO 


« 

X 










04 1 


X 




• 






049 

U H 


X 


I 






* 


/■ 04 3 

c U •t -/ 


X 


1 X 








044 

U *T •t 


X 




1 ^ 


■ 






04 *5 


X ;! 


1 ^ 


"J 






046 


X 


X 








047 


X 








• 


048 


X 


1 k 








049 






X 






050 


: : — 


\ ?)8 


X 




mc 


•f .1 — , 

■ \ 
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Addendum 1 1 - TERMOB FREQUENCY BY PROGRAM 
Addendum 11-9 - Automotive Mechanics Program (Cont'd) 



TERMOB No. t 


Qulncy 


Nashoba 


Shawsh^en 


^ 1 

026 


X 


V 

A 


X 


1 027 1 


X 


Y 

A 


Y 

/> 


1 028 1 


X 


Y 
A 


X 


[ 029 1 


X 


y 

A 


X 


K 1 
I 030 


X 


Y 
A 


X 


1 p^l j 


V 

— A 


y 

A 


X * 


1 


X 


y 

A 


X 


1 


X . 


Y 

A 


Y 


1 1 


X 


Y 

A 


X 


1 035 


X 


Y 

A 


X 


036 


V 

A 


!A 


X 


1 037 


1 X 


y 

A 


x' 


1 038 


X 


y 

A 


X 


1 039 


X 


Y 
X 


X 


1 040 


1 ^ 


X 


X 


1 041 


1 X 


Y 

r\ 


X 


1 042 


1 X 


X 


X 


1 043 


1 V 
1 A 


y 

A 


X 


1 044 


1 V 

1 A 


y 

A 


X 


1 045 


1 V 

1 A 


y 

A 


X 


1 046 


1 X 


X 


X 


047 


X 


X 




048 


X 


X 


X 


1 049 


X 


X 


X 


1 050 


1 * 
1 ^ 


X 


X ' 
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Addendum II - TERMOB FREQUENCY BY PROGRAM 
Addendum 11-9 -.Automotive Mechanics Program (Cont'd) 



TERMOe No. 


Qu 1 ncy 


Nashoba 


Shawsheen 


051 


X 


X . ' 


y 

A 


052 


X 


A 


y 

, A 


053 


X 


V 


A 


054 


X 


V 
A 


X 

A 

7' 


055 


X 


V 
A 


y 

A 


056 


X 


A 


Y 


















■-' ' ■ ■ , . 






















































































■ 












































^ 
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Addendum 1 1 - TERMOB FRBJUENCY BY PROGRAM 
Addendum 11-10 - Drafting Program 



i 



TERMbe No. 


Northeast 


Brook line 


Qu I ncy 


001 


X ° 


X V - 


X . 


002 


X 


-f 

X 


X 


003 
\j \j <^ 


• 

X 


X 


X 


004 

W V "T 


X 


X 


X 


005 

\J \J 


X 


X 


X 


006 
\j \j \j 


X 


X 


X 


007 


X 


X 


X 


008 


X 


X 


X 


u u ✓ 


X 


X 




0 J Q 


X 






Ot 1 

V 1 1 


X 




X 


012 


X 


X 


X 


013 




X 


x 


0 14 




X 


X 


01 5 


X 




X 


016 


X 




X 


01 7 


X 


X 


X 


018 

W 1 w 


X 


X 


X 


019 


X 


X 





02 0 

V/ v 


X 


X 


A 


02 1 


X 




X 


022 


X 




X 


023 


X 




- X 


024 


X 


X 


X 


025 


X 




1 ^ 
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Addendum 1 1 - TERMOB FREQUENCY BY PROGRAM 
Addendum 11-10 - Dr'aitfng Program (Cont'd) 



ERIC 



TERMOe No. 


tfortheast 


Brook line 


Quincy 




X 




X 


uZ / 




X 


X 




X 


X 


X 


no Q 

UZ > 


X 


X 


X 


0 rv 

U 4^ U 


X 


- X 


X' 




X 


X 


X 


n '''i 9 


X 




xV 


U«7<^ 


X 




V\ 


U ^ H 


X 


X 


. /\ X 


U^PZ? 


X 


X 


^ 


U U 


X 




X 


u^ / 


X 


X 


X 




X 


X 




U 7 


X 


X y 


X 


U H U 


X 


X \ 


X 


U H 1 


X 


. X 


X 


U Z 


X 


X ; 


X 


u** ^ 


X 


X 

/ 


X 


U 


X 


x' 


X 


OA'S 


- • X 


X 


X 






















• '/.-""'/ "' ' 
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Addendum 1 1 - T^RMOB FREQUENCY BY PROGRAM 
Addendum 11-11 - Woodworking Program 




Addendum 1 1 - TERMOB FREQUENCY BY PROGRAM 
' Addendum 11-11 - Woodworking Program (Cont'd) 




Addendum 11 - TERMOB FREQUENCY BY PROGRAM 
Addendum 11-12 - Electrical Program 



TERMOB No. 



Shawsheen 



Nashoba 



Ou 1 ncy 



GDI 



002 



003 



X 



004 



005 



-006- 



007 



008 



X 



009 



010 



01 



012 



013 



014 



015 



016 



017 



018 



019 



X 



020 



021 



022 



X 



023 



er|c 



024 

025- 



X 

X 



66 



68 



'Addendum M - TERMOB FREQUENCY BY PROGRAM 
Addendum 11-12 - Electrical Program (Cont'd) 



TERMOB No. 1 


Shawsheen 


Nashoba 


Qu 1 ncy 


026 1 


X * 


X 


X 


027 * 1 




- 


X 


098 1 

1 W ^ U 1 


X 


X " 


X 


1 n9Q * 1 


X ^ 


X 


X 


1 030 1 


X 


X 




1 031 v 


. X 


X 




1 039 1 
1 yj J ^ 1 




X 




f '< ' - " * 1 
1 033 1 




XI 




r 034 


X 


X 




1 0 35 




X 




1 036 
1 \j J \j 




X 




1 037 


X 


X 




1 038 




X 




1 039 




X 




1 040 

1 \j ^ \j 


1 X 


X 




04 1 


1 

1 ^ 


X 




042 

\y "T 




X 




04 3 


1 


X 




044 








045 


1 






046 








047. 








048 


1 ^ 


X 




049 


X 


X ■ 




050 


1 ^ 


-X 
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Addendum 1 1 TERMOB FREQUENCY BY PROGRAM 
Addendum 11-13 - Electronics Program 



TERMOB No. 


f 

) 

Qulncy 


^ Shawsheen • 


^ NashobS" 

V 


00 1 


Y 

A 


A « 


X 


002 


Y 
A 

^ 


X 


X 


r\ f\ X 
003 


Y 
A 


^ * X 0 


X 


004 


Y 
A 


i 

*> X 


X 


r\ r\ c 

005 


Y 
A 


X 


X 


006 


y 

A 


X 


X 


007 - 


Y 
A 


X 


X 


008 


Y 
A 


X 


X 


r\ r\ f\ 

009 




X. 


X 


010 




X 


X 


0 1 1 


Y 
A 


X 


X 


0 1 2 




X 


X 


0 I 3 


Y 

A 


X 


X 


A 1 A 
0 1 4 


A 


X 


X 


A 1 J? 

0 1 0 


Y 

A 


X 




U 1 D 


Y 
A 


X 




A 1 ^ 


Y 

A 


X 




U 1 o 


Y 

/\ 


X 




' * A 1 Q 




X . 




A O A * 

020 


Y 


X 


*x 


021 


X 


,x 


X 


022 


X 


X 

— 1 


\ X 


023 


X 


X 




024 


X 


X 




025 




X 


X 
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Addendum 1 1 - TERMOB FREQUENCY BY PROGRAM 
Addendum 11-13 - Electronics Program (Cont'd) 



TEFM)B No. 


Quincy 


Shawsheen j 


Nashoba 


026 1 


Y 
A 


X 1 


X 


027 1 


V 
A 


X 1 


X 


.028 1 


Y 
A 


X j 


X 


029 1 


Y 


X " 1 


X 


030 1 




X 


X 


* 031 1 


Y 
A 


X 


X 


032 1 


Y 
A 




X 


033 1 


Y 
A 


X 


1 X 


p34 1 


Y 
A 


X 


X 


035 1 


Y 
A 


X 


X. 


036 


Y 
A 


X ' 


X 


037 


A 


X 


X 


038 


-V 


X 


X 


039 




X 




040 


y 






041 


y 

1 


X 




042 


1 Y 
1 A 






043 


1 y 


X 




044 


1 y 


X 




r\ A c 

045 


1 y 


X 




046 


1 - ^ 


X 




047 


1 ♦ 

1 ^ 


X 




048 


1 ^ 


i 7 — 

X 




049 








1 050 
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Addendum II - TERMOB FREQUENCY BY PROGRAM 
Addendum 11-13 - Electronics Program (Cont'd) 



TERMOB No. 


Qulncy 1 


Shawsheen 


Nashoba 


f. . ■ ' 

05 1 


1 






A tt O 








U !) ^ 


y 1 

A 1 






OCX 

054 


V 1 






n c 
























> 








*- 
























* 


















* 


















































1 




































> — ^ . ' 


73 







Addendum 1 1 - TERMOB FREQUENCY BY PROGRAM . 
Addendum 11-14 - Plumbing Program 



TERMOB No. 


Quincy ^ 


Nashoba 


Northeast 


001 


X 


X 




002 


X 


X 




003 


X 






004 


X 


X 




005 


X 


. X 




006 


X 


X 




007 


X 


X 




008 


X 


X 




009 


X 


X 




010 


X 


X 




- ON 


X 


X 




. 012 


X 


X 




013 




X. • 




014 


X 


X 




015 


X 


* 

X 




016 


X 


X 


4 


017 


X 


X 




018 ' 


X 


X 




019 


X 


X 




020 


X 


X 




021 




X 




022 


X 


X 




,023 


. X 


X 




024 


X 


X 




r25 


X 
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Addendum 1 1 - TERMOB FREQUENCY BY PROGRAM 
Addendum 11-14 - Plumbing Program (Cont'd) 





i. 



Addendum 1 1 - TERMOB -FREQUENCY BY PROGRAM 




Addendum 1 1 - T|RM08* FREQtfSNCY BY PROGRAM 
Addendum 1 1-15 - #aph!c Arts Program (Cont'd) 



n 



TERMOB No. 


i 1 r- 

North^st I 


Brook! Ine 


*Qulncy 


026 1 


— 

— [ 




X 


027 1 


\ 

A . 1 




X 


028 1 






X 


029 1 


Y 1 

A 1 


Y 
/> 


X 


030 1 


V 1 
A 1 


X 


X 


«t 1 
03 1 1 


Y 1 
A 1 


X 


X 


032 j 


A 1 


y 

A 


X 


033 1 


Y 1 


X 

A 


X 


034 1 




Y 

A 

• 


X 


035 1 






X 


036 1 






X 


f\ T 

037 


4 




X 


038 






X 




























1 A 




























* 






1 — . 




























i \ , — , — 


1 78 
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Addendum II - TERMOB FREQUENCY BY PROGRAM 
Addendum H-16 - Machine Shop Program (Cont'd) 



TERMOB No. 


Nashoba 


Quincy 


Shawsheen 


o 


X 


X 


X 




X 


X 


X 


n 9 A 


X 




X 




X 


X 


X 


u u 


X 


X 


X 




X 


X 


X 


u 4? z 


X 


X 


X 




X 


X 


'X 




X 




X 




X 


X 

.1 


X 


U J o 


X 


X 




U J / 


X 


X 


X 


U J> o 


X 




X 


U V ^ 


X 


X 


X 


HAH 


X 


X 


X 




X 


X 


X 




X 


X 


X 


VJ *t J ^ 


X 




. X 




X 


X 


X 


U *T #/ 


X 


X 


X 


046 


X 


X 


X " 


047 


X 


X 


X 


048 


X 




X 


\ 049 


X 


X 


X 


050 - 




X 


X 
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Addendum 1 1 - TERMOB FREQUENCY BY PROGRAM 
Addendum 11-16 - Machine Shop Program (Cont'd) 



TERMOB No. 


Nashoba 


QuTncy 


Shawsheen 


1 1 


X 




X 


n 9 1 


X 




X 


t 


X 


X 


X 


O^A 1 


X 


X 


X 


1 C\^^ \ 


X 


X 


X 


1 (\^ir\ / 1 


X 


X 


X 


1 nR7 » 1 
1 ^ 1 




X 


X 


















































1 ^ 














'W— 


jL 
















































1 ^ ,1.1. 


























1 81 







i 
1 
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Addendum 1 1 - TERMOB FREQUENCY BY PROGRAM 
Addendum 11-17 - Metal working Progran 



TERMOB No. 


Shawsheen 


Qulncy 


Nashoba 


QUI 


A 


X 


X 


/\ A O 

002 


Y 
A 


X 


X 






X 


X 


004 


A 


X 


X 


A A C 

005 


A 


X 


X 


A A £ 

OOo 


A 


X 


X 


A A*7 
00 / 


V 

A 


X 


X 


A A O 

OOo 


Y 
A 


X 


X 


A AQ 

ooy 


b- — — 


X 


X 


A 1 A 
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Addendum i I - TERMOB FREQUENCY BY PROGRAM 
AddendUfn I I-J7 - Metalworking Program (Cont'd) 
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Addendum 1 1 - TERMOB, FREQUENCY BY PROGRAM 
Addendum 11-18 - Cosmetology Program 



TERMOB No: 
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002 



003 
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014 



015 
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Adden dum' 1' I - 1 8" "CdSme toi ogy Prog ram • (Con t ' 
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Addendum 1 1 - TERMOB FREQUENCV^BYJ'F?OGRAM 
Addendum 11-19 - Quantity Foods Program 
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Addendum 1 1 - TERMOB FREQUENCY BY PROGRAM 
Addendum 11-19 - Quantity foods Program (Cont'd.) 
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Addendum ^ Quantity Foods Proaram (Cont^d) 
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ADDENDUM 1 1 1 



TERMOB CXJVERAGE INFORMATION 
BY PROS^K^^ 

1. Distributive Education - Objectives were added acrosWhe entire program 
to raise estimated coverage to 95 percent. 

2. Pr actical Nursing - WhI le the TERMOBs hands-on skills covered only 40 
' percent o^ the cognitive Instructional program* they covered 85 percent 

of the Job-entry skills for Licensed Practical Nurses. Twelve objectives 
were added In the maternity and pediatrics divisions extending estimated 
coverage to 90 percent. 

3. Oc cupational Chi Id Care - The program was generally complete lacking only 
a division on Infant care Including pedlates for nursery school employees 
bringing estimated coverage to 95 percent. 

4. Accounting - Generally complete, three TERMOBs added, estimated coverage 
of 90 percent. 

5. Data P rocessing - Coverage was low In this program, 50 percent, necessl- 
tattng the addition of 22 TERMOBs across the board In all divisions to 
bring extlmated coverage to 90 percent. 

6. General Office - full coverage, estimated 95 percent 

7. Stenog raphic, Secretarial - Although coverage was high (90 percent) 13 
objectives were added in the typing division, specifically focusing on 
typewriter skills bringing estimated coverage to 9$ percent. 

8. Automotive Body - Generally complete, no additional objectives, 90 per- 
cent estimated coverage. 

9. Automotive Mechanics - Coverage was broadened to Include air conditioning 
systems. Seven objectives were added In this area to bring estimated 
coverage to 90 percent. 

10. Drafting - Coverage was found to be deficient In architectural, electronic, 
and pipe drafting. A division on sketching was added, as well. Alto- 

V gether, seven TERMOBa were added bringing estimated coverage to 80 percent. 

11. Woodworking - Although full coverage Is estimated In this program, revl- 
srons of existing objectives In three divisions were mafide. Estimated 90 
percent coverage. 

12. Electrical - Although coverage was high, It^was determined that overall 
degree of difficulty of the TERMOBs was exqesslve. Ten objectives were 
added to broaden the base and balance the difficulty level of the 
electrical program (accommodation to D. Murphy - Nashoba Valley). ^ 
Estimated 90 percent^ coverage. 
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TERMOB Coverage Information by Program (Cont*d) 



*I3. Electronics - Coverage In this program suffered due to missing ski II. areas 
and redundancy of some objectives. The program was completely restructured. 
TERMOBs were added In cable and cable harness areas, wh! I e^ extensive addi- 
tions^ were made In the circuit construction division^* A total of 25 
objectives were added to bring coverage to estimated' 90 percent 

14. Plumbing and Plpef tttlng Coverage was weak (60 percent) In both the 

heating and pipefltting areas. In several divisions, the basic Job-entry 
skills had been omitted. The program was entirely restructured, Including 
the addition of 42 objectives across the board to brlnS^overage to. 
estimated 95 percent. 

I ^ " . ■ " - "I 

15* Graphic Arts - Low coverage (47 percent) led to the addition of 24 TERMOBs, 
with emphasis on coWiercIal art skills (prevalent In Massachusetts)* in 
addition, three TERMOBs.were added In the bindery division to bring 
estimated coverage to 90 percent* , ^ : 

16. Machine Shop - Coverage was , extended by strengthening the bench-work 
division to include assembly, layout, and drillpress. Two units In the 
Inspection division were added to Include Indicators and thread measure-^ 
ments. With the addition of 12 objectives estimated program cove rage^Tfas 
extended to 85 percent. 

17. Metal^orking ^ Eleven objectives were added In the welding and cutting 
diylsions. (Further additions required) Coverage estimated at 8d percent. 

"^16. Cosmetology - 95 percent or full coverage In this area^ hto additions. 

19. Quantity Foods - Consolidation of som^ objectives, revised procedures In 
several others, and an additional 15 TERMOBs brought extl mated coverage to 
90 percent. * ' 



ERIC 



FALL PACKAGE ViELD TEST VIDEO-TAPE 
DOCUt^NTATION 



41 

A video-tape documentary of the field 
test is available from the Management 
Information System for Occupational 
Education^ Division of Occupational 
Education ^ Department of Education^ 
182 Tremont Street ^ Boston^ Mass, 
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